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' Abstract 

An operator form of asymptotic expansions for Markov chains is estab- 
lished. Coefficients are given explicitly. Such expansions require a certain 
modification of the classical spectral method. They prove to be extremely 
■ useful within the context of large deviations. 
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Introduction 



Let {£fc}fcez+ be a homogeneous Markov chain defined on a probability space 
(f2, J 7 , P). Denote by § and S, respectively, the phase-space and its a— algebra 
of measurable subsets. Further, denote by P(x, A), i6§, A £ S the transition 
probability kernel of the chain. It means that for each A £ S, P(x, A) is a non- 
negative measurable function on S while for each x £ §, P(x, A) is a probability 
measure on S. In what follows we assume that the chain is uniformly ergodic. 
So, there exists a stationary distribution denoted by ir. 

Consider the sequence of random variables Xq = f(£o), . . . ,X n = /(£ n ) 
determined by a measurable function /: S — > R. In what follows we assume that 



a 2 = E n [X$] + 2^E^[X X n ] > 0. (1.1) 
n=l 



There exists a huge literature concerning the limit theorems for successive 

sums S n = J2?=i Xi, n = 1, 2, For our purposes, it is enough to keep in 

mind only the works of S. Nagaev (1957) and (1961) and the monograph by 
Sirazhdinov and Formanov (1979). Despite the theory of limit theorems is well 
developed, some settings seem to be set aside. For example, in Szewczak (2005) 
it was shown that the Cramer method of conjugate distributions assumes a 
special form of the local limit theorem that was not considered before. The 
case studied in Szewczak (2005) concerns Markov chains with a finite number 
of states. It worth noting that the large deviation theorems, established there, 
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proved to be very useful in statistics of Markov chains (see A. Nagaev (2001) 
and (2002)). The mentioned form of the local limit theorem means the weak 
convergence of the measures 

Q^(A x B) = ay/toripW [Xi + . . . + X n G A, £„ G B] , (1.2) 

where 

pW(£i €Ai,...,C„ 6 4) = / P(x,dxi) / P(x 1 ,dx 2 )... [ P(ar n _i,cLc n ), 

4e5, fc = 1, . . . , n, B £ S, A G B(R) and x£§. 
Define the linear operators 



(K n g)(x) = J P(x,dxi) ■ ■ J P(x n - 1 ,dx n )g(x n )K n (x 1 ,...,x n ); g G L°°(/x), 

(1.3) 

where K n , n = 1, 2, . . . , are measurable kernels, and L°°{n) is the Banach space 
of measurable functions equipped with the essential supremum norm 

| £/ | = esssup|si(x)| = inf{a; |#(x)| > a} = 0}, 

X 

/x is the initial distribution, i.e. /i(A) =P[^ei], i G 5. 

Various probability measures of interest can be represented as a set indexed 
family of the operators (1.3). If one puts 



K n>A (xi,.. .,x n )= aV2TmI A (f(xi)-\ h/(x n )), g(x n ) = I B (x n ), A G B(R), 

then (1.2) takes the form 

Q^(AxB) = (K ntA I B )(x). (1.4) 

Similarly, 



V x [ Xl+ ^ Xn G A,£ n G B] = (K nA g)(x) (1.5) 



provided 



K n , A (xi, ...,x n ) =I A I I , 3(ar„) = is(x n ). 

When x is fixed the weak convergence of the measures (1.4) (or (1.5)) means 
a form of the classical local limit (or central limit theorem) . Naturally, we expect 
that the measures (1.4) weakly converge to A x ir while (1.5) converge to v x tt 
where A is the Lebesgue measure on B(M) and 



Such statement can be embedded into the following scheme of convergence. 
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Define 

||K||+= sup _ \Kg\. (1.6) 

{g>0;g£L°°( M ), | g | <1} 

Consider a family of sequences {K^}, A£ic Z3(R). We say that a sequence 
K n>J 4 is LF% (^u)-strongly convergent to if 

sup ||K„ a — Ka||+ —>■ as n — > oo. (1.7) 

Let i = {z e 1| (— oo, zcr)}. If the sequence of operators is defined as in (1.5) 
then the limit operator in (1.7) has the form 

(K A g)(x)=i/>(x)v(A) [ g(s)Kds) 

where ip(x) = 1. This fact is formally more general than e.g. Th. 2.2 in Nagaev 
(1957) though its proof does not require serious efforts. It is of much greater 
interest to establish the operator form of the asymptotic expansions for the 
sequence {K„ j2 } determined by the kernels 

"■n,z\ x li ■ ■ ■ i x n) — -M— 00,2) I / — 

Such asymptotic expansions is basic goal of the present paper. The paper 
is organized as follows. In Section 2 the main results are stated. In Section 3 
a new estimate for the so-called characteristic operator in the neighborhood of 
zero is established (Cf. Lemma 1.6 in Nagaev (1961)). The proofs are given in 
Section 4. 

2 The main results 

In order to state the main results of the paper we have to introduce the 
indispensable notation. We are going to establish an asymptotic expansion of 
the form 

fc-2 

\\K n<z -2^n 2 A m>2 || + = o(n 2), (2.8) 

m=0 

where A mj2 are linear operators defined on L°°( / u), m = 0, 1, . . . , z£l. The 
operators A mj2 are expressed through the Hermite polynomials and certain 
derivatives of the so-called characteristic operator 

P(e)(g)(x) = J e ie ^g(y)P(x,dy), 

where g 6 L°°(/x). More precisely, let X(9) be the principal eigenvalue of P(0) 
and Pi(0) be the projection on the eigenspace corresponding to X(9). Assume 
that P(0) is fc-times strongly differentiable at 6 = and P = P(0) is L°°-regular 
(or primitive), i.e. there exist C > and 7, < I7I < 1, such that 

|P"0-IL,|<C| 7 rM, 9€L°°M, (2.9) 
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where 

(n g )(x) = V>(x) / g(s)fi(ds) = iP(x)E w [g] 



s 



(Cf. Gudynas (2000)). Then Pi(0) and lnA(6>) admit the following MacLaurin 
expansions: 

m=0 m=0 

Here, the operators p^ can be explicitly expressed in terms of P and II 
(see Lemma 3). The coefficients 7 m , m = 0,1,... are called cumulants. In 
what follows we assume 71 = E^f/] = thus 72 = a 2 , where a 2 is defined 
by (1.1) and 73 = ^3 is defined in Lemma 1.2 in Nagaev (1961). Let 91 and 
n denote the distribution function and the density function of the standard 
normal law. Introduce the operators defined on L°°(n) : Ao, z = 9T(z)II, A VjZ = 

E^o^'WP?. where 

a,- (2) = -n(z) ^ a j,u-jH v -j (z), a u = —n(z)H„-i, 



1 "~ J 1 

— TT — 
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7m+2 



11 k m \ Um + 2)!<r m + 2 < 

m=l 

and /C m = {(fei, . . . ; = m, ki > 0,i = l,...,m}. Thus, the 

operators A^^ are well-defined provided P(#) is fc-times strongly differentiable 
at = and <r > 0. 

Let r(6) be the spectral radius of P(0). It is well known that r(#) inherits 
many principal properties of the characteristic functions. In order to establish 
asymptotic expansions (2.8) we have to assume that 

r{9) < 1, + 0, and limsupr(#) < 1. (2.10) 

|0|-»oo 

The second inequality in (2.10) is analogous to the well-known Cramer con- 
dition (C). As to the first one it guarantees that the distributions of Y^l=\ Xi 
for all sufficiently large n is non-lattice. 

The operator form of asymptotic expansions implies such properties of the 
considered Markov chain as strong differentiability of P(#), primitiveness and 
(2.10). Of course, one could simply assume that these properties take place. 
Another way is to give a simply verified condition that guarantees these prop- 
erties. As such we take the following 
Condition (*): 

there exist a > and (3 < 00 such that for every Borel set A of a positive 
measure fi we have a/j,(A) < P(x,A) < /3fj,(A) for fi-a.a. i£§. 

This condition enables us to verify the required properties by the initial 
distribution fi. For example if Condition (*) is fulfilled then (2.10) takes place 
provided fif = n°f~ l is non-lattice and 
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lim sup 1/1/(0)1 < 1, (2.11) 

where ju/ = / e l9 ^ y ^ n(dy). Moreover, if / |/(y)| fc /Lt(dy) < oo then P(0) is fc- 
times strongly differentiable. It should be noted (see the proof of Lemma 3.1 
in Jensen (1991)) that Condition (*) implies a 2 = 72 > 0. 
Now we, are able to state the main results. 

Theorem 1 Let Condition (VP) is fulfilled. If f \ f(x)\ k /j,(dx) < 00, fc > 3, 
cmo? /xj satisfies (2.11) then (2.8) holds. 

As in the case of asymptotic expansions for i.i.d. variables (see Gnedenko 
and Kolmogorov, 1954, §42, Th. 2) the following statement does not require 
the condition (2.11). 

Theorem 2 Let Condition (*) is fulfilled. If f |/(x)| 3 //(dx) < 00 and fif 
is non-lattice then (2.8) holds with k = 3. 

In order to clarify the specificity of the limit theorems given in the operator 
form consider two examples. First, let be a finite state Markov chain, 
i.e. § = {l,...,d}, d > 3. Denote by P the transition matrix. The entries 
of P v ,v > 0, we denote by p[j\i,j S S, pf^ = For a real function / on 
§ define the matrix P^ with the elements f(j)pij, i,j £ S. The following 
statement is of independent interest. 

Corollary 1 Suppose that transition matrix P is strictly positive. If /(£o) 
is non-lattice and J2k=i ^kfik) = then uniformly in z G R the matrix 

(P[S n < zay/n; i n = j I £ = «])i,jeS 

is approximated by the matrix 

m(z)n + n- 1 / 2 n ( z )(^(i _ z 2 )n - i ^np«(p^ - n) + (p" - n)p(%) 

(2.12) 



* 6<7 3 CJ 

u>0 



with an error o(n l / 2 ). Here, 

(ill ir 2 ... TTd \ 

n = 



\ 7Tl 7T 2 ... 7T d / 

Another particular case of independent interest is covered by the following state- 
ment. 

Corollary 2 Lei S = [0, 1]. Suppose that the transition density p(x,y) is 
such that < p- < p(x,y) < p + < 00. If f(£o) is non-lattice and J f(u)ir(du) = 



5 



then the linear operator (2.12) L™- strongly approximates the operator g 
E x[I[s n <zaV^9(&i)} with an error o{ n - 1 / 2 ). Here, 



(Ug)(x) = / g(s)fi(dsWx). 

Note that the classical scalar form of the presented statement is: 

P n [S n < za^} - K(z) = n~ 1 / 2 n(z)0(l - z 2 ) + o{ n - l l 2 ) (2.13) 

(see e.g. Th. 2 in Nagaev (1961)). The corollaries show that the operator form 
of asymptotic expansions is much more sensitive to the initial conditions than 
the scalar one. It should be emphasized that the spectral method suggested 
by S. Nagaev (see e.g. Nagaev, 1957) remains efficient under this new setting 
though requires some modification. Furthermore, the cumbersome calculations, 
that are typical for asymptotic expansions, can be implemented using the pack- 
age Maple. This power software proved to be very efficient for such purposes. 



3 Characteristic operator 

Given m G N let us define operator P^g = Pf m g. The following lemma 
is an extension of the well-known result due to S. Nagaev (Cf. Nagaev, 1961, 
pp. 71-75). 

Lemma 1 Suppose that (2.9) holds and P^ 1 ) is a bounded endomorphism. 
Then there exists £ = £((7, ||P (1) ||) such that for \0\ < £, 

P»(0) = A n (0)Pi(0) + Q n (0) + (P n - n) (3.14) 

and |A(0) - 1| < 8, where ||Pi(0) - n|| = 0(\ 6 |), ||Q n (0)|| = 0( K n \ B |), 

« = J + ii7i, s = \-\w- 

Proof of Lemma 1 

Write T = {|Cl = «}, Ti = {|C -1|=5} and D = {\(\ > k] n {|C - 1| > 6}, 
where ( e C. Denote by R(C, 6) the resolvent of P(0) and set R(C) = R(C,0). 

^ = 2||p 1 ( 1 )|| ( 3(3+c) ) ' Consequently for | |< £, ( G D (see §1 in Nagaev 
(1961)) we may define the projections 

Thus (3.14) holds with Q„(0) = P n (0)P 2 (0) - (P n - n). We see at once that 

P(0)R(C,0) = -I + CR(C,0) 

therefore, 

n 

p"(0)R(c, e) = - j^p^r-v -1 + c n R(c, o). 
k=i 
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So it easily seen that 

^ m = C n (R(C,0) - R(C))dCII 

^ 1 f 2n n 2(3(3 + C)) 3 ||P(#)-P|| 

~ K (l-|7l) 2 (6(3 + C)-l + | 7 |) - d ^^ 

Similarly we have ||Pi(0) — II|| = 0(\ 9 |). The proof is completed. □ 

The following lemma deals with the existence of the "operator" moments. 



Lemma 2 If 



| / \f(y)\ k P(x,dy)\=0 (3.16) 

J|f(w)l>L 



lim 

L ^°° " -'|/(w)|>£ 



P(0) = ^^!pH + o (|^) ) (3.17) 

m=0 m ' 

where p( m ) are bounded for < m < k. 

Proof of Lemma 2 
Indeed, we have 

/j-i^-i)^-!)^ + ^ _ j(*-i)p(*-i)(0)0) _ i fc y e iey g{y)f k {y)P{ ■ , dy) 

= i k J e w ^g{y)f k {y) j\e ihs f^ - l)dsP( • , dy). 
Now, choose L be sufficiently large positive number. Since, 
inf{^; || (if(y)) k j\e lhs ^ - l)dsP(x,dy)\ > K} = 0} 

< inf{^; a*{x; | / (i/(y)) fe - l)dsP(x,dy)\ > K} = 0} 

■/|/(»)l<i -/o 

+ inf{K; ^{x; | / (tf{y)) k f\e iha ^ - l)dsP(x,dy)\ > K} = 0} 

J|/(j/)|>L JO 

<h k ^\h\+2 \ [ \f(y)\ k P(x,dy)\ 
2 J\f(v)\>L 

the lemma follows by the Taylor formula. □ 

The next lemma presents a series expansion for characteristic projector. 

Lemma 3 If a primitive operator P satisfies (3.17) then 

k 

P 1 (6) = ^^r { r ) + o(\e\ k ). 

* T71.1 



m=0 
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Proof of Lemma 3 

Put, for short E(C) = E n >o( pn ~ n )C _n_ \ and E = E(l). In view of 
(1.10) in Nagaev (1957) and (3717) we obtain for \9\ < £ 



R(C, 9) = R(C) + E R(C)( E P (m) R(C)^V)" + o{\6\ k ). 

l — ' ^ — ' ml 

n>l m=l 

Hence taking in the above coefficient at iO and using (3.15) we get for k = 1 

*?' = ^/ ri (^ + E (C))P (1, (^ + E(())d C 

+J_/ ^-p( 1 )ndC = np( 1 )E + EP«n 

2vr« Jn C — 1 

by Cauchy's integral formula. For 1 < m < k arguments are similar. We have 
to replace every R(C) by + E(£) in 



P 



(m) 
1 



m 
2tH 



! r ^_ p("i) p(^) p(f() 

f E R(0— rR(0— r ---R(0— rR(C)dC, v k >i. 

Ji 1 vi+v 2 + . ..+vi=m 1 z J 

□ 

Now, we are in a position to represent the principal eigenvalue of the char- 
acteristic operator in a power series. 

Lemma 4 If a primitive operator P satisfies (3.17) then 

AW = 1 + ^Mi + ^p/«2 + ^p/us + • • • + ^Mfe + o{\9\ k ). 

Proof of Lemma 4 

It follows from (3.14) that 

ttP(0)Pi(0)V> = A(0)7rPi(0)Y>. (3.18) 

Denote \W = vrpfV- By virtue of (3.17) and Lemma 3 

Mo) e w&f = e (e (™V M *r "V^)+o(if i*). 

i/=0 m=0 ^=0 ^ ' 

Since A<°) = A<°) = 1, A^ = A^ = 0, and A^ exists so by the Leibniz formula 
AH = »m = E (7jvrPMpi m ^V - E (7) AMA^-" ). (3.19) 



u=l v ' u=2 



By (3.19) 72 = A( 2 \ for m > 2 also use the equation (1.13) in Petrov (1996). □ 
The following theorem is the main result of the present Section. 
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Theorem 3 If a primitive operator P satisfies (3.17), k > 3 and a 2 > 
then there exists r)k > such that for T n = n^a^fn and \ 9 \ < T n we have 



k~2 m 



P n (-^=) -e""(EE -^h^m-j(i9)P?) -(P» - n)|| (3.20) 

m=0 ]=0 J 



where 



< 4ej(i^'~ 2 + i*i fc_l + \ & \ k + i#i 3(fc - 2 v^ + oA K n ), 

n 2 v n 

m m TT 1 ( ^ + ^0) m+2 \ km 

W = ( llol(m + 2)!^J- 

(fei,fc 2 ,-,^)e/C I/ m=l "i \v i y / 

Proof of Theorem 3 

Let < 7/3 < £ be such that sup|g| <r?3 \X ( - 3 \9) — < a 3 . Put, for short 

2 ^— 

T n = rnin{ .3 °" 3 ,r/s}a^/n. By Taylor's formula for | \ < T n we have 

| Af _^_)| > 1 62 ' g ' 3 ^ 3 ' + ^ 3 + >1 T " T n 3 (H^I+^ 3 ) 



v cr^/n ~" 2ra 6t72ct 3 2n 6n5a 3 

cr 6 cr 6 2 24 

- 1 " 50(11^1 + ^ 3 ) 2 " 6 • 125(||/7 3 | + a 3 ) 2 > 1 " 50 ~ 25' 

Hence for | 9 \ < T n by Taylor's formula and Lemma 4 

g 2 (ig) 3 ^ , (ig) 4 M4 (^) 4 4 r „ 9n 

ramA( — =) = — — + + — z 1 (3. 21) 



fc!n~cr fc (fe - l)\n~a k Jo 



where W^{x) = J^r In X(y)\ y=x — j^. Further, it is evident that we can insert 

2 

Vk < m in T n = min{^^|-j-^3y,7/ fc }o-^/n, such that for \9\ < T n we have 



where c& = sup^g^i] | (a?) | . Since Wk(-^y^) — > n 0, so by the Lebesgue dom- 
inated convergence theorem we get — x) k ~ 1 Wk(-^^)dx = o(l). By virtue 
of (3.14), Lemma 1 and (3.21) we obtain 

9 2 (i fl)3 M 3 ( i9 )4 (i9 f (ie) k 

\\P"(J-) - e 2 + ^ + ^~ 8 " + + k ^^ k p i{ J_) _ (P n _ n)|| 



- — H 1 £=2 Tfc 



+ 0(A K n). 
0V n 



f {i9) k Sj(l - x )^ Wk (^)dx ^ 
(fc — l)!n 2 cr fc 



0(1) 
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By (3.21) and the inequality \e x — 1| < (xle' 1 ', we find that for | 6 \< T n we have 

[k — l)\n 2 (jkjq o\jn n 2 kin 2 a h 

Hence, 



||P»(-*=) - e 2 + ^ + ^~ 8 " + + fc! „^ CTfc 7fe p l( __) _ (P n _ n)|| 

(Jy/n Cfyjn 

< exp{-^ + • • • + -^-(iTfcl + Pfc)}4&o(l) + 0( -^U B ) 
z fc!n 2 cr* n 2 cy' 4 

2 2 15||^ 3 |+(7 d 15§|/x 3 |+(7 d n — oy n 
< (l)J^exp{-^} + 0(-^L K n). 

Thus expanding exp{ [r^=p + • • •+ ■ ^ff 2 — 7fe} and using Lemma 3 and Taylor's 

formula for P^— ^=) we obtain (3.20). □ 

The following lemma provides an estimate for the iterates of characteristic 
operator (for the proof see Lemma 1.5 in Nagaev (1961)). 

Lemma 5 Let Condition (*) is fulfilled. Then for n > 1 and | g | < 1 

I p™(% I < (Ji-^(i-\M0)\ 2 )^) ■ 

4 Proofs 

Proof of Theorems 1 and 2 

By virtue of Condition (\I/) and §1 in Nagaev (1957) P is primitive in L°°(/j) 
(alternatively one can use Proposition 3.13 in Wu (2000)). Moreover, it follows 
also that 

lim I f \f(y)\ k P(x,dy)\<P lim / |/(y)|V(dy) = 

L ^°° J\f(v)\>L L ^°° J\f(v)\>L 



so that (3.16) holds. Write F gn (z) = F g ^ n (z) = (K HiZ g)(-), and G gn {z) = 

Y^m=o n ~^ -^m,z9- Let Kg n (z) be the distribution function that assigns the 
mass (P n - U)g(-) at 0. Put, 

H gn (z) =G gn (z) + K gn (z), H gn (6) = j e i6x dH gn (x), F gn (6) = j e i9x dF gn {x). 
Note that F gn {9) = P n (^)(<?) and 

G gn (6) = J e i6x dG gn (x) =e~ e 4(j2 T^lljC^rn-A^? 9{-)\ 



m=0 v v ' j=0 
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Because of 

| H gn (z + y)- H gn (z) | < | G gn {z + y) - G gn (z) \ + | (P n - U)g | , 



v+\v\ 



d f d d 

G gn {z + y) -Gg n (z) = y— G gn (z) + sgn(y) / (— G gn (z + u) - — G gn {z))du 



y-\y\ 

2 



thus in view of Th. 5.3 on pp. 146-147 in Petrov (1996) and (2.9) we have 
| F gn (z) - G gn (z) | < | F gn {z) - G gn {z) - K gn (z) | + C\ 7 \ n | 9 \ 

< \ I \F 9 n(0)-H gn {6)\^- (4.22) 

K J\9\<T \V\ 



\9\<T 
TFT 



8 2r(-' 

sup I Q-G gn {z) | +C| 7 r(l + \g\. 



7T 



Now, since sup^ | J^G gn (z) | is bounded and \j\ < 1 whence by (4.22) for 
T = n k ,k > 4, we get 

| F gn (z) - G gn (z) | < \ [ | F gn {9) - H gn {9) \ § + o(M)- (4.23) 

By virtue of Th. 3 

/ | F gn {6) - H gn {9) | § (4.24) 



<^^/ (\e\ k - 3 + \o\ k ^ + \e\ k + \e\ 

n~ J\e\<T„ 



n~ J\e\<T n 
This established, we have to show that 

| F gn {6) - H gn {9) | 



■'•■^)e~ e 4&e + ^LO{K n ) 



In 



lT„<\d\<n k 
For this observe that 



\0\ 



ae<o(l4Xy 

n 2 



I G gn (9) | 
T n <\e\< n k \Q\ 

and that by (2.9) 



L 



d9 < 2 / e - ^ 



k—2 m 

EE 

m=0 j=0 



(iey 



n 2 j'lcr-? 



(4.25) 



d# 



1*1 



/ | £ gn (0) - G gn (0) | ^ < 2C fc | 7 | n | 9 | Inn = o(-l|i)- 

Further, by Lemma 5 and (2.11) there exists 9q such that for any t > 9q 



n 



n 



T„<|6»|<n fe 



r<|6»|<n fc 
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which with the latter inequalities proves (4.25). Consequently, the substitution 
of (4.24) and (4.25) into (4.23) yields (2.8). For the case k = 3 set T = T n r n 
and choose a sequence r n — > oo such that we have 

/ I F 9 n{9) \f=[ I (P(9)T 9 \^=\ 9 \ (n-V). 

JT n <\e\<T n r n \V\ JT n <\e\a^i<T n r n H 

This completes the proof. □ 

Acknowledgment. The author thanks A. Nagaev for his comments concerning 
this exposition. 
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